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ABSTRACT 

The number of galaxies with measured redshifts 2; ;^ 1 is at present rapidly 
increasing, allowing for measurements of their correlation function. The 
correlations function C.i'ipyv) is measured in redshift space, as a function of the 
angular separation and velocity difference v. The relation between angle 
and velocity difference depends on the cosmological model through the factor 
H{z) ■ D{z), where H{z) is the Hubble parameter and D{z) is the angular 
diameter distance. Therefore, the cosmological model can be constrained by 
measuring this factor from the shape of the contours of the C,{ip,v), if the 
effect of peculiar velocities can be taken into account. Here, we investigate 
this method applied to the high redshift Lyman-break galaxies. The high bias 
factor of this galaxy population should suppress peculiar velocity effects, leaving 
the cosmological distortion as the main contribution to the anisotropy of the 
correlation function. We estimate the shot noise and cosmic variance errors 
using linear theory. A field size of at least 0.2 deg^ is required to distinguish 
the Einstein-de Sitter model from the flat A = 0.7 model, if 1.25 Lyman-break 
galaxies are measured per square arc minute. With a field of Ideg^, the 
cosmological constant can be measured to ~ 20% accuracy if it is large 0.5). 
Other equations of state for a scalar field can also be constrained. 



Subject headings: cosmology: theory - large-scale structure of Universe 



1. Introduction 

Alcock & Paczyhski (1979) suggested the possibility of using the clustering statistics 
of galaxies in redshift space to constrain the global geometry in the universe. The basic 
idea is that, since clusters of galaxies should not be preferentially aligned along any 
direction relative to a fixed observer, their average shape ought to be spherically symmetric 
Therefore, if galaxies were following the Hubble expansion of the universe, without any 
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peculiar velocities, the average extent of clusters in radial velocity Vr (measured from 
redshifts) and their angular size ^0 are related to the physical size of the cluster L by 
Vr = H{z) L, and ip = L/D{z), respectively. Here, H[z) and D{z) are the Hubble constant 
and the angular diameter distance at the redshift z where the clusters are observed. The 
condition that clusters are spherical on average can then yield the value of H{z) ■ D{z). Of 
course, the effect of peculiar velocities must be included in order to apply this method, since 
any clustering induced by gravity will generally introduce peculiar velocities (Kaiser 1987) 
that will cause a distortion of similar or greater magnitude than the differences between 
cosmological models. 

Recently, the rate at which galaxies at high redshift are being identified has dramatically 
increased thanks to the Lyman limit technique, using the fact that the reddest objects 
among faint galaxies will often be galaxies at the redshift where the Lyman limit wavelength 
is between the two bands used to measure the color (Guhathakurta et al. 1990; Steidel & 
Hamilton 1993; Steidel et al. 1996). For example, very red objects in U — B are likely to be 
galaxies at redshift z ~ 3. 

The galaxy correlation function, ^(r), which measures the probability in excess of a 
random distribution of finding a galaxy at a real space separation vector r from another 
galaxy, has been measured for the first time for the population of Lyman-break galaxies 
(Giavalisco et al. 1998). The correlation length, defined to be the separation at which 
the excess probability is equal to that of a random distribution, has been estimated to be 
~ 2.1h'^ Mpc (for an fio = 1 universe; the symbol Q is used here for the ratio of the density 
of matter in the universe to the critical density, the subscript indicates redshift zero), 
about half of the correlation length of galaxies at 2; = 0. The bias, defined as the ratio of 
the correlation function of galaxies to that of matter at a fixed separation, is estimated to 
be large, ~ 4 for an Qq = 1 universe and smaller for universes with smaller dark matter 
content (Giavalisco et al. 1998). Count-in-cells analysis of the Lyman-break sample used 
in conjunction with a Press-Schechter mass function for the halos also indicate that these 
galaxies are likely to reside in rare, massive halos that existed at the time (Adelberger et 
al. 1998; Steidel et al. 1998; see also Coles et al. 1998 and Wechsler et al. 1998 for models 
of clustering of Lyman-break galaxies). These rare halos are expected to be much more 
clustered than the underlying matter distribution as originally suggested by Kaiser (1984) 
(see also Mo & white 1996, for analytic models of bias as a function of the mass of halos). 
Both these analysis indicate that the population of Lyman-break galaxies is likely to be 
highly biased with respect to the underlying matter distribution. 

In this paper we investigate the feasibihty of using the distortion of the redshift space 
correlation function of this population of galaxies to measure cosmological parameters. This 
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possibility has been suggested before by Matsubara and Suto (1996) who proposed using 
the ratio of the value of the correlation function parallel to the line of sight to its value 
perpendicular to the line of sight at a fixed separation as a measure of the distortion. In 
this paper we express the angular dependence of the cosmological redshift space distortion 
of the correlation function as a multipole expansion. We are also specifically interested 
in applying this method to the highly biased, high redshift population of Lyman-break 
galaxies. Ballinger et al. (1996) have investigated the use of the full functional form of 
the redshift space power spectrum to separately measure the peculiar velocity effects and 
cosmological geometry effects. In essence this reduces to using both the quadrupolar as 
well as the octapolar distortion of the redshift space power spectrum to simultaneously 
constrain the cosmological constant as well as the parameter /? = Q^-^/fe, where b is the 
linear theory bias. In this paper we fix the bias of the galaxy distribution by using the 
constraints on the matter power spectrum at redshift zero derived from observations of 
cluster abundances. On large scales the power spectrum of matter at any redshift is related 
to the power spectrum at redshift zero through the linear growth factor. We can then use 
the lowest order quadrupolar distortion of the power spectrum alone to constrain other 
cosmological parameters such as the cosmological constant. Ballinger et al. (1996) also 
estimated the errors involved in such a survey although in Fourier space. We estimate the 
errors in estimating cosmological parameters directly from the correlation function. 

On sufficiently large scales, where density fluctuations are in the linear regime, the 
angular form of the redshift space correlation function depends only on two parameters: 
the cosmological term H{z) ■ D{z), and the bias of the galaxy population. This paper 
presents a general method of estimating these two parameters from the basic data of a 
galaxy redshift survey, and evaluates the size of the survey that is necessary to determine 
the two parameters (or a combination of them, given other constraints from the galaxy 
distribution at the present time) with a given accuracy. We shall analyze the sensitivity of 
the method to a variety of cosmological models, placing special emphasis on models that 
contain a cosmological constant or a new component of the energy density of the universe 
with negative pressure christened Quintessence (e.g. Kodama & Sasaki 1984; Peebles & 
Ratra 1988; Caldwell et al. 1998), given the recent evidence from the luminosity distances 
to Type la supernovae (Garnavich et al. 1998; Perlmutter et al. 1997; Reiss et al. 1998) 
suggesting an accelerating universe. As pointed out by Alcock & Paczynski, the quantity 
H[z) ■ D{z) is more sensitive to this type of component than to space curvature. 

The paper is arranged as follows. In §2 we describe the effect of geometric distortion. In 
§3 we introduce the method for measuring the effects of cosmological geometry and peculiar 
velocity effects on the redshift space correlation function. In §4 we present predictions for 
a variety of cosmological models, and in §5 we estimate the errors in the observational 
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determination of the redshift space correlation function contributed by shot noise and by 
the finite size of the observed volume. Our discussion is given in §6. 



2. Method 

A redshift survey consists of measuring the radial velocity and angular position of 
every galaxy included in the sample. We denote by n the unit vector along the line of sight, 
which, if the survey does not extend over a very large area, can be considered constant for 
all galaxies. Given a pair of galaxies, let v be the difference between their radial velocities, 
and ip their angular separation. We define their vector separation in redshift space w as 
(see Figure 1) 

w • n = V , 
|w-(w -11)111 = H{z)D{z)i^ , 

vJ" = v"" ^\H{z)D{z)i)f . (1) 

where ii{z) and D{z) are the Hubble constant and the angular diameter distance at the 
mean redshift of the survey, z. We also define for future use, as the cosine of the angle 
between the vector separation between two galaxies and the line of sight: 



The quantity H{z)D{z) contains the dependence on the cosmo logical model. If we 
could measure the correlation function of galaxies directly in real space (measuring distances 
to galaxies instead of radial velocities), then the simple requirement that the correlation 
function should be isotropic would yield the value of H{z)D{z). However, pecuhar velocities 
should obviously introduce an anisotropy in the correlation function, and their effect needs 
to be included. 



2.1. Model Dependence of H{z)D{z) 

Figures 2 and 3 show the ratio H{z)D{z) / Hs{z)Ds{z) for various models, where 
Hs{z)Ds{z) is the value of H{z)D{z) for a "fiducial" model, here adopted to be the 
Einstein-de Sitter model, with fio = 1 in the form of pressureless matter. The symbol Qq is 
used here for the present ratio of the density of matter in the universe to the critical density. 

Two of the models shown in Figures 2 and 3 are the open model (with space curvature 
but no negative pressure components) and the cosmological constant (or A) model (with no 
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space curvature and a component with pressure p — —pc^)- The third of the models shown 
is a Quintessence or Q model with no spatial curvature and a component with equation of 
state p — —pc^/?). 

The quantity H{z)D{z) is much more sensitive to A than to space curvature, and is 
also sensitive to the Q model, with a different redshift dependence. In general, a component 
of the energy density in the universe with negative pressure can have any equation of state, 
but the case p = —pc^/S implies an expansion mimicking exactly that of an open universe. 
Therefore, H{z) in our Q model is exactly the same as in the open model. However, 
whereas in the open model the negative space curvature increases the angular diameter 
distance compared to the Einstein-de Sitter model, cancelling almost exactly the decrease 
in H{z), the flat geometry of the Q model results in smaller angular diameter distances, so 
H{z)D(z) is smaller than in the Einstein-de Sitter model due to the decrease of H(z). 

It is useful to note at this point that in order to obtain useful constraints on 
cosmological models, H{z)D{z) must be measured to an accuracy better than ~ 10%. In 
order to distinguish, between a cosmological constant and a Q model, H{z)D{z) must 
of course be measured at several redshifts with even higher accuracy. In practice, we 
can expect that any constraints obtained from measuring H{z)D{z) should be combined 
with other knowledge obtained, for example, from the luminosity distances to Type la 
supernovae. 



3. Effect of peculiar velocities on the redshift space correlation function 

For a given value of H{z)D{z) the effect of peculiar velocities on the shape of the 
redshift space correlation function is well described in the literature (e.g. McGill 1990; 
Hamilton 1992;Fisher 1995) and the redshift space correlation function, ^(w), is given by : 

|(w) = J2 Di{P,w,z)-Pi{p), (3) 

1=0,2,4 

where. 
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b{z) 



where b{z) is the bias parameter for the class of objects under survey and Q{z) is the 
ratio of the density of matter to the critical density at redshift z. The coefficients of the 
expansion in Legendre polynomials, Di, can be expressed as: 



Di{P,w,z) = {-iy-MP)-^i{w,z), 



(4) 
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where 

A2 

and 

ii{w,z) = ^-^Jdkk' P{k,z) ji{kw) , (5) 

and ji is the 1th order spherical Bessel function. The function P{k, z) is the linear matter 
power spectrum at redshift z in terms of the k vector in velocity space. 

Note that ^oiwjz) is proportional to the real space matter correlation function at 
redshift z. Hence, Do is equal to the real space two point correlation function for this class 
of objects except for the factor of Ao[/9(-2)]. We also mention here that the D2 coefficient is 
negative implying a squashing of the contours of the correlation function along the line of 
sight as is expected due to the peculiar velocities from infall on large scales. 

Throughout this paper we use the simple model of linear, local, constant biasing of 
galaxies, i.e. the overdcnsity in the number of galaxies, Sg{w), is given by 6 x 5m{w), where 
Sm{w) is the overdensity in matter and b the bias. For general deterministic local bias 
models, this is valid in linear theory where 6g < 1 { for b > 1 and 6m ^ < —1 is 

unphysical) (Gaztahaga & Baugh 1998). Hence, our results are likely to be valid on large 
scales where the correlation function is smaller than one. In reality, biasing is not easily 
modeled since it depends on the complex process of galaxy formation, which is poorly 
understood. Several alternative models of galaxy biasing have been suggested, including 
non-local biasing mechanisms (Babul & White 1991; Bower et al. 1993) and stochastic 
biasing (Dekel & Lahav 1998; Tegmark & Peebles 1998). However, for stochastic (local) 
models, on large scales, the bias (the ratio of the correlation function of galaxies to that of 
matter) will be independent of scale (Scherrer and Weinberg 1998) as in the case of a linear, 
local, constant biasing scheme, although the variance in the measured correlation function 
will be larger for such models. On the other hand, non-local models of galaxy biasing in 
which the efficiency of galaxy formation is modulated coherently over large scales, result in 
scale dependent bias. In the absence of a well motivated model for bias, we have assumed 
the simplest scale independent model for the bias. It is valid only on large scales and is 
not generally valid for non-local biasing models. We also mention that we have only taken 
the linear infall velocities into account in calculating the redshift space correlation function 




- 7- 



(see Equation |^). On small scales non-linear velocity effects ('Fingers of God') will also be 
important (e.g. see Fisher et al. 1994 for the redshift space correlation function of IRAS 
galaxies) . 



3.1. Effect of geometric distortion 

In order to test the magnitude of the geometric distortion, we calculate the anisotropy 
introduced in the correlation function by varying H{z)D{z) about its fiducial value, 
Hs{z)Ds{z). Let the product H{z)D{z) for any other model be given by 



H{z)D{z) = Hsiz)D,{z) ■ ^1 + aiz) , (6) 

where a{z) is defined as the geometric distortion parameter. Then, using equations (1) and 
(2) we have, 

= u;^ ?7^(a,/^.) , 
r/^(a,/i,) 

where 

r]\a, fis) = I + a{l - fil) . (8) 
We can now express equation (^ in terms of the variables Ws,fis in the fiducial model: 

f(w)= Di{f3,w,-v,z)-Pi{^) . (9) 

1=0,2,4 ^ 

Rewriting this as a series in Pi{^s), 

i{w) = J2Ci{P,Ws,z)-Pi{fXs) , (10) 

one can immediately see from the angular dependence in t] that the expansion is an infinite 
series in Pi{fis), with the new coefficients of the Legendre polynomials, Ci, being given by, 

C„(/5,u;„z)= (^^) J2 f DiiP,Ws-v,z)-Pii-)-Pn{f^s) dfx, . (11) 

^ ^ ^ 1=0,2,4-^ 

Thus, expressing the coefficients Di of a given model in terms of fiducial coordinates 
introduces angular distortion in the redshift space correlation function. 
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4. Results for the geometric distortion 

In this section wc present our results for the sensitivity of the anisotropy of the 
correlation function to the geometric distortion parameter, a. We consider here a galaxy 
survey with a mean redshift of 3, the typical redshift of the current Lyman limit galaxy 
surveys. Our fiducial model is = 1-0, with the standard cold dark matter (SCDM) 
power spectrum. On large scales the power spectrum at redshift 3 is related to the power 
spectrum at redshift zero by the linear growth factor. We adopt the cluster normalization 
for the power spectrum at redshift zero, obtained by requiring that the observed density 
of galaxy clusters with a given X-ray temperature matches the theoretical prediction. The 
constraint obtained in this way can be expressed in terms of the fluctuation in a sphere of 
radius 8/i~^ Mpc, erg, given by (Eke et al. 1996): 

(78 = 0.52 ^0°-^^"°, for Ao = 0, 

and 

(78 = 0.52 , for fio + Ao = 1- (12) 

In Figure 4 we plot the Ci{f3,Ws) coefficients for / = 0, 2 and 4, for our fiducial model 
(lighter lines) and the A model with Qq = 0.3, Aq = 0.7 (bold lines). The horizontal axis has 
been labeled both in units of velocity (wg) and comoving space separation s, calculated for 
the fiducial model. The observed correlation function is given by the monopole term in the 
Legendre polynomial expansion, Cq{(3, Wg). In order to match the value of the Co coefficient 
to unity at the observed correlation length of 2.1/i~^ Mpc (comoving) for — 1 (Giavahsco 
et al. 1998), which corresponds to a correlation velocity of 450kms~^, the bias required is 
6 = 4. For the Qq = 0.3, Aq = 0.7 model, the bias required to match the computed Co 
coefficient to 1 at the observed correlation velocity of 450kms~^ is 2.3. On account of 
the large bias in these two models, we can rely on the linear theory that we have used for 
peculiar velocity distortions of the correlation function we have shown in §3 for Cq ^ 1, or 
Wg ^ 400 km s"^ 

Our goal is to measure the multipoles Ci{(3,Ws) of the correlation function and use it 
to constrain the geometric distortion parameter, a. From Figure 4 we see that on scales of 
approximately lO^kms^^, the C2 coefiicient is a 10% perturbation on the monopole term, 
whereas the octapolar term C4 is a smaller contribution at ~ 3% for the Aq = 0.7 model. 
Once we fix the bias, the Cq coefficients for the two models shown are similar to each other, 
except on very large scales. The quadrupolar coefficients for the two models on the other 
hand are very different. The C2 coefficient for the A model, affected by geometric distortion, 
is larger by a factor of 2 compared to the Qq — 1 model and comes to within a factor of 2 
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of the monopole term on scales ~ lO^kms"^. As we mentioned in §2, the C2 coefficient is 
less than zero which implies a squashing of the contours of constant ^(w) along the line of 
sight. Thus we see that for our choice of the fiducial model, the primary effect of geometric 
distortion caused by a model with a positive cosmological constant is to cause a further 
squashing of the contours of ^(w). We mention here that the C4 coefficient is even more 
sensitive to geometric distortion than the C2 coefficient. Its value is approximately 10 times 
larger for the Aq = 0.7 model as compared to the fiducial A = model. A measurement 
of the C4 coefficient will give us additional information with which to test the bias model 
that we have used. It will be interesting to compare the value of the linear bias parameter 
parameter derived from a simultaneous measurement of the cosmological constant and the 
j3 parameter using both the C4 and C2 coefficients, to the value obtained by comparison of 
the galaxy distribution to the matter power spectrum at redshift zero. 

We now show that the difference in angular distortion of the correlation function in the 

two models is primarily due to the change in the distortion parameter and is not strongly 
dependent on the choice of the power spectrum. In Figure 5, we plot the coefficients Q, for 
the fixed cosmological model fig = 0-3, Aq = 0.7, but two different correlation functions. The 
bold lines correspond to the power spectrum of the A model with these same parameters. 
The lighter lines are for the same cosmological model, but with the power spectrum of 
an Qq = 1 CDM model as a function of k/H{z). We see from this figure that at velocity 
separations ^ lO^kms"^, the differences in the power spectra dominate the differences 
in the Q coefficients. But on smaller scales the geometric distortion effect is the most 
important effect. In particular the C2 and C4 coefficients are similar once the monopoles 
for both models are normalized to unity at the observed correlation length. Thus the 
ratios of the coefficients C2/C0 and C4/C0 are only weakly dependent on the shape of the 
power spectrum. This shows that it should be possible to measure the geometric distortion 
parameter even if the power spectrum is not known accurately from independent methods. 

5. Error estimates 

In this section we compute the accuracy in the measurement of the multipoles of the 
redshift space correlation function from a typical survey volume and test the feasibility of 
the method described above. Currently, the typical observed fields have a size ~ 12' on 
each side. The redshift range of each field extends from z = 2.6 to 2; = 3.4 with a surface 
density of approximately 1.25 Lyman-break objects per square arc minute within this 
redshift range (Adelberger et al. 1998). In our fiducial model {Hq = 1), this corresponds to 
a width of 2 X lO^kms"^ and a depth of 6 x lO^kms"^. We consider for the purpose of 
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error estimation, a wide field of view of ~ 3°. We shall later discuss the scaling of the errors 
with the angular size of the field of view. 

Any detailed calculation of the errors in a survey will depend upon the precise geometry 
of the survey volume and the selection effects involved in the survey. Here, we consider two 
of the sources of error, shot noise and cosmic variance. Shot noise is caused by the discrete 
nature of the galaxies from which we measure the correlation function. Cosmic variance 
arises due to the finite volume we use to estimate a statistical quantity. We calculate these 
errors for a single cylindrical survey volume with a radius of 1.5° {75h~^ Mpc for f2o = 1 
model), and depth extending from z = 2.6 to z = 3.4 {300h~^ Mpc for f2o = 1 model). At 
the current estimate of surface density of Lyman-break galaxies of 1.25 per square arcmin 
(Adelberger et al. 1998), approximately 30000 galaxies would be included in our survey 
volume. 



5.1. Shot noise 

In order to estimate the redshift space correlation function, we bin pairs of galaxies 
with respect to their separation velocity Wg (computed in the fiducial model) in widths of 
Awg. The redshift correlation function is then estimated (denoted by subscript E) as, 

f,(w.) = 1^ - 1. (13) 

where Np{ws,fis) are the number of pairs with separations between Wg and Awg with 
the separation vector making an angle cos~^(/is) with the line-of-sight and Np{ws) is the 
ensemble average of a random distribution of the same quantity. There are various different 
estimators for the correlation function discussed in the literature that minimize the error 
of the estimator due to the unknown true average density of the galaxies at the redshift 
of the survey (for a discussion see Hamilton 1993). Our shot noise will be dominated by 
the small number of pairs of galaxies we have in each of our bins. Since we are currently 
only interested in an estimate of this error, we have adopted the simpler estimator for the 
correlation function. To analyze the data from a survey one should use a more sophisticated 
estimator to minimize its variance. 

Using equation (|I^) we obtain the estimate of the Ci coefficients as given below for 
/ ^ 

2/ + 1 1 

ClAv^s) = , , ■ E Plif^s^) , (14) 

2 Np{ws) 

where A''^ is the number of pairs with separations between Ws — Awg and Ws + Awg, and 
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Np{ws,Hs) is the average number of pairs for a random distribution of galaxies in the same 
bin . The summation is performed over the pairs of galaxies (denoted by subscript i) in the 
bin centered at Wg- In order to calculate the statistical average of the estimator, we have to 
perform two integrals. First, for a given number of pairs separated by Wg, we average over 
their possible orientations. The probability that a given pair of galaxies with separation Wg 
is oriented along /i^ is given by ip{ws,fis), where 

If ^^ 1 +f(w^s,Ais) , 

1 + Cq{Ws) 

The 1 + Cq{ws) factor in the denominator comes from normalizing 1 + ^{ws,fis) over fig- 
Here we have assumed that a given pair of galaxies can have any orientation with respect to 
the line of sight. This is clearly not true, for example for a pair of galaxies close to the edge 
of the survey volume. In order the circumvent this difficulty we consider a smaller volume 
within the total survey volume which we call the "reduced volume", hereafter denoted as 
Vr such that the edges of Vr are a distance Ws away from the edges of the total survey 
volume. We only consider pairs of galaxies such that at least one of the galaxies is within 
Vr . For a random distribution of galaxies, a pair chosen in this way is not biased to be 
aligned along a particular direction. We can see that the largest separation at which we can 
measure the coefficients C/ is the radius of the survey for which Vr goes to zero. 

Secondly, we have to average over the distribution of the number of pairs of galaxies in 
each bin. Calculating the averages (denoted by brackets) yields 

< Q,eM >= 2^ + 1< > I ^(^^^^jp^(^j^^^. (16) 

2 Np{ws) J 

This gives us that < Ci^e{ws) >= Ci{ws). This result can also be shown to hold for the 
monopole term. 

In a similar way to the calculation of the statistical average of the Ci coefficients, we 



can calculate the mean square variation of Ci coefficients. Using equation ([1^) we have 



The statistical average of the above equation gives the mean square variance of the Ci 
coefficients, < Cf^— < Cf^ », denoted by af, as. 



af{ws) 



'2l + l\ (l + Co(w.)) 



Np{ws 
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We mention here that in deriving the above equation we have assumed a Poisson 
distribution for the number of pairs in each bin. This assumption is not strictly vahd since 
every pair separation is not independent. Hence, one may expect some underestimation 
in the Poisson errors we have calculated but this should be small since the second term 
in equation {\[7\ } is proportional to Cf. Figure 6 shows the expected la error for the Ci 
coefficients due to shot noise. Each successive bin is centered at Ws with value 1.5 times 
that of the previous bin and hence, each bin has width 2/5ws- The average number of pairs 
Np{ws) in the bin centered at Ws and width 2 x Awg for a random distribution of galaxies 
within the survey volume is given by 

2 

Np{ws) = ^ X Vr X A7rw'',2Aws , (19) 

where rig is the average density of galaxies within the survey volume. This is an 
underestimate of the number of pairs in the bin since it counts only half of the pairs of 
galaxies of which one of the galaxies is outside Vr. At larger separations this underestimation 
is maximum since, in this case, a larger fraction of all the pairs in the bin have one of the 
galaxies outside of Vr. Thus our shot noise is an overestimate by a factor < ^/2. 

We can see from Figure 6 that with shot noise alone, the C/ coefficients are best 
measured in the velocity range 10^ ^Ws^ lO^kms"^ for a survey of the size and geometry 
that we have assumed. The errors on the multipoles scale as (2/ + 1)^, and so they 
are smaller for the Co coefficient and higher for the C4 coefficient as compared to the 
quadrupole. For scales close to the radius of the survey the shot noise error increases rapidly 
since Vr is now very small. For scales ~ lO^kms"^, with shot noise alone, we can measure 
the C2 coefficient to a few percent accuracy, both for the fiducial model as well as the A 
model and hence distinguish a large cosmological constant as in our model with Aq = 0.7 
to high statistical significance. The shot noise error on the C4 coefficient is small for the 
Aq = 0.7 model we have shown but larger for models with smaller cosmological constants. 
Considering shot noise alone, on scales of ~ lO^kms"^, the C4 coefficient can be measured 
if it is present at the level of a few percent of the monopole, which in turn would indicate a 
large energy density in the form of a cosmological constant or some form of quintessence. 
We also note here that the number of pairs of galaxies at a fixed separation is proportional 
to Vr. Hence for separations small compared to the radius of the survey, the shot noise 
error scales as the inverse of the angular size of the survey. 
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5.2. Cosmic Vciriance 

The cosmic variance of a survey volume results from the sparse sampling of the universe 
made by the small survey volume. It occurs even if the overdensity at each point within the 
survey volume is accurately known, and is independent of the number of observed galaxies. 
We estimate the cosmic variance in this section using linear theory. 

A finite volume estimate (denoted by subscript E) of the correlation function is given 
by, ^ 

iE{ws,h) = — £x6{x,h)6{x + Ws,h) . (20) 

Vr JVr 

In the above equation, x is constrained to be within Vr such that its boundary are a 
distance Ws away from that of the full survey volume and x + Wg is within the full survey 
volume. For every point x within V/^, the overdensities at x and x + Ws are accurately 
known. The ensemble average of the estimator gives. 



Vr JVt? 



Vr JVr 

= m , (21) 

where as previously, quantities without the subscript E stand for their true values. Similarly, 

<Ci,e(ws) >^Ci(w,). (22) 
The variance in Ci^e{ws) can be computed using, 

< CIe{Ws) >= (—J—j J (^l^sl J dHs2 < ^E{s,l^sl)iE{s,Hs2) > Pl{l^sl)Pl{l^s2) , (23) 

where, 

< iE{ws, Hsi)iE{ws, iis2) >= y J d^xi J d^X2 < 6{xi)6{xi + wZi)6{x2)6{x2 + WI2) > , 

(24) 

where \wsi\ = \ws2\ and w^i • n = /x^i, Ws2-n = fis2- 

In order to simplify the above expression, we approximate the overdensities to be in 
the linear regime. The linear overdensities are Gaussian distributed and the four point 
expression in the above equation can be expressed in terms of two point correlation 
functions : 

< 5(xl)5(fi + Wwl)5{x2)8{x2 + Ws2) >= l{Wsl)l{Ws2) 
+|(f 1 - X2)l{xx - f 2 + Wsl - Ws2) 

+|(fl -X2+ Wsl)l{xi -X2- Ws2)- (25) 



Thus the last two terms in equation (|25|) contribute to the root mean square variance in 
Ci,e{u!s)- Since ^e{u!s,^s) is independent of the azimuthal angle in equation (|23|), we can 
also integrate over this angle. Therefore we can express the root mean square variance as, 



>-- 



'2i + r 



dfli dfl2 



Pl{fJ'sl)Pl{fJ's2) 



- X2+ Wsl)^{Xi -X2- Ws2) + ^{Xl - X2)^{xi 



X2 + Wsl - Ws2 



(26) 



The method we employed in the calculation of the above integrals is detailed in the 
Appendix. Figure 7 displays the expected cosmic variance errors for our survey volume for 
the multipole coefficients. For all three coefficients, the cosmic variance dominates the error 
on large scales, while the shot noise contribution is larger on smaller scales. The error is 
smallest in the region Ws ~ 3000 km s~^, so this is the best scale at which to measure the 
quadrupole and octapole coefficients and hence estimate the geometric distortion factor. 

As mentioned before, the cosmic variance error that we have calculated assumes linear 
theory and hence we have underestimated the contribution to the errors from fluctuations 
and non-linear velocity effects on small scales. As mentioned in §3 if we adopt a local 
but stochastic model for the distribution of galaxy number density as a function of the 
underlying mass density, then the bias will still be scale independent on large scales, but 
there will be a larger variance in the measured correlation function. In the absence of 
a well motivated stochastic biasing model, we have not estimated the variance in the Ci 
coefficients arising from such a model of the bias. Depending on the true nature of bias, we 
may be underestimating the variance of the measured correlation function. A more precise 
estimate of the error can only be given by the direct analysis of numerical simulations, a 
project we plan to return to in a later paper. 

We note here that we have not assumed that the mean overdensity within the survey 
volume is zero. The fluctuation in the mean overdensity is the primary source of the cosmic 
variance error for the monopole component of the correlation function. This fluctuation of 
course does not affect the higher multipoles of the correlation function and hence on small 
scales the error on the higher multipoles is smaller than on the monopole coefficient. With 
the combined shot noise and cosmic variance errors the C2 coefficient can be measured to a 
few percent accuracy both for the fiducial r2o = 1 model as well as the A models which have 
a larger quadrupole coefficient compared to the fiducial model. Thus, with our estimate 
of the errors, we can distinguish a geometric distortion factor of about 15% corresponding 
to a A model with Aq = 0.7 to high statistical significance. From Figures 6 and 7 we also 
see that for our survey volume, the C4 coefficient can be measured to ~ 20% accuracy for 
the Aq = 0.7 Model. The errors are larger for models with smaller cosmological constants. 
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Therefore, a measurement of the octapolar coefficient is possible if it is present at the 
level of a few percent of the monopole on scales of ~ 3 x lO^kms"^ as in case of a large 
cosmological constant. Since the error on C4 is large, a simultaneous measurement of both 
the f3 parameter as well as the cosmological constant from the anisotropy of the redshift 
space correlation function alone is difficult. This has been indicated earlier by Ballinger 
et al. (1996). If the the octapolar coefficient can be measured, and the bias parameter 
constrained, it will be interesting to compare its value to the one obtained by comparison 
of galaxy clustering to the assumed underlying matter distribution. But we emphasize that 
when we assume that the amplitude of the matter power spectrum is known, and only 
one parameter needs to be measured from the redshift space correlation function, then the 
quadrupolar geometric distortion effect of the cosmological constant can be measured to 
high accuracy. 

For scales much smaller than the radius of the survey, the cosmic variance error scales 
as the inverse square root of the volume of the survey and hence as the inverse of the angular 
size of the survey. Thus both shot noise and cosmic variance have similar dependence on 
the angular size of the survey on small length scales. A large cosmological constant may be 
distinguished with high statistical significance for smaller angular size surveys depending 
upon other sources of error. Considering only the shot noise and the cosmic variance that 
we have estimated, for a survey of angular size 1°, with a factor of three increase in the 
errors, we can still measure the quadrupolar coefficient affected by a geometric distortion 
parameter of 15% with an accuracy of approximately 10% on a scale of 3 x lO^kms"^. The 
error is larger for smaller distortion factors. Since a variation of the cosmological constant 
from zero to 0.7 changes the quadrupolar coefficient by a factor of 2, we can use a linear 
relation between the two to make an approximate estimate of the accuracy with which the 
value of the cosmological constant can be measured. This gives us that a large cosmological 
constant, for which the error in the difi^erence of the C2 coefficient with respect to its value 
in the fiducial model is small, can be constrained with an error bar of approximately 20% 
with a 1° field of view. Since in fact this linear relation is incorrect and the geometric 
distortion parameter is more sensitive to a variation in the cosmological constant when 
it is large (BaUinger et al. 1996), the error we have quoted will be somewhat smaller for 
large Aq 0.5). For a field of view of this size, the C4 coefficient can also be measured, 
although with a large error of ~ 60%, if it is present at the level of a few percent of the 
monopole as in the case of geometric distortion with respect to the fiducial — 1 model 
by a cosmological constant Aq = 0.7. 

For a smaller field of view, the monopole coefficients have to be measured on scales 
smaller than 3000 km s~^ where shot noise is the dominant source of error. For example for 
a field size of 1/2°, the quadrupole coefficient corresponding to a 15% geometric distortion 
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parameter can still be measured to an accuracy of approximately 50% on a scale of 
lO'^kms"^. Hence it can be distinguished from the fiducial = 1 model at the 2a level. 
For smaller scales the error is larger while to measure the distortion parameter at larger 
scales a larger field size is required. Thus a field at least 1/2° in diameter, corresponding to 
an area approximately four times the currently used field size, is required to distinguish a 
Aq = 0.7 model from our fiducial = 1 model. 

6. Discussion and Conclusions 

In this paper we have investigated the feasibility of using the high redshift population 
of Lyman-break galaxies to measure the geometric distortion effect and hence constrain 
cosmological parameters. The method is particularly sensitive to components of energy 
density with negative pressure and in particular to the cosmological constant. The principal 
advantage of using this population of galaxies is their high bias with respect to the 
underlying matter distribution. This tends to suppress the peculiar velocity effects and 
makes it easier to measure the geometric distortion effect. As pointed out by Ballinger et 
al. (1996), a simultaneous measurement of the bias and the cosmological constant using the 
redshift space distortion alone is difficult except in case of a large cosmological constant. 
In this paper we assumed that the matter power spectrum at redshift 3 is related by the 
linear growth factor to the matter power spectrum at redshift zero which is constrained 
by observations of cluster abundances. We fixed the bias of the Lyman-break galaxies by 
comparing their clustering to the assumed matter power spectrum at redshift 3. Then 
we only need to measure one parameter, the geometric distortion parameter, from the 
anisotropy of the correlation function. This permits us to use the lowest order quadrupolar 
distortion of the redshift space power spectrum to constrain the geometric distortion 
parameter to high accuracy. In cases of a large energy density in a cosmological constant 
or quintessence, the octapolar coefficient may also be measured. An interesting test would 
then be to compare the value of the bias parameter derived from the additional information 
provided by the octapolar term to that determined by comparing the galaxy clustering to 
the matter power spectrum. 

We estimated that in order to distinguish a fiat model with Aq = 0.7 from the 
Einstein-dc Sitter case, at least a 1/2° sized circular field of view is required. Currently the 
observation fields have sizes of approximately lO', which arc too small for measurements 
of geometric distortion, both due to shot noise and cosmic variance. It is preferable to 
measure the distortion effect on large scales where the effects of peculiar velocities can 
be analytically computed using linear theory. For this reason, it is better to use a single 
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large field of view than to combine data from several small fields of view which provide 
data only on smaller scales. For a more accurate measurement of the distortion parameter 
larger field sizes are required. We estimated that for a field size of 3°, the best scale at 
which to measure the ratio of the quadrupole coefficient to the monopole is approximately 
3000 km s^^, or 15/i~^ Mpc in the f2o = 1 model and somewhat smaller for a smaller field. 
Since the difference in the quadrupolar coefficients for the fiat Aq = and Aq = 0.7 models 
can be measured to ~ 20% accuracy with a circular field of diameter 1°, we made a rough 
estimate that a large cosmological constant ^ 0.5 can be measured with this precision. 

Our cosmic variance was estimated using the linear correlation function and we have 
underestimated the error due to fiuctuations and non linear velocity effects on small scales. 
We have also used a very simple local non-stochastic scale independent model for the bias. 
Stochastic bias will lead to variance in the measured correlation function which we have 
not accounted for. A full calculation of the errors including non linear effects will require 
analysis of numerical simulations, which we will discuss in a future paper. 

I wish to acknowledge Jordi Miralda-Escude, my thesis advisor, who gave me the 
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I have had with him. I also wish to thank Patrick MacDonald, Brian Mason and David 
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Appendix 

Calculation of integrals for the cosmic variance 

We perform the integrals required in equation (|26|) for the case of a cylindrical volume 
of radius R and length L^. Since equation ( pSj) depends only on the difference vector 
xi — the six dimensional integral over xi and £2 can be reduced to a two dimensional 
integral. We define sum and difference vectors x+ and X- respectively as 

X+ = Xi + X2 

x^ = xi — X2, (Al) 

Denoting our integrand as f{x-) we have the following result. 

J I £x^(fx2f{x.) = ^J (fx. K,(f_) /(x1), (A2) 

where V+(af_) is the volume occupied by the sum vector x+ for a fixed difference vector x_. 
Denoting the components of the X- in cylindrical coordinates as p_ and z_, V"+(a;_) is given 
as ^ 

y+(5-) = {2R^co.-^(^) - p_ (r^ - 4V } • 2(L. - |^_|). (A3) 



This preprint was prepared with the AAS M5t;X macros v4.0. 
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Let us first consider the contribution of tlie first term in equation (p6|), 
+ — W2), and denote it by < ^{w) >/: 

< 4^ J^) >,= (^^j I rf^xi I {hix^Mf , (A4) 

where, 

= j '^Pi{^,)l{x^+w,) . (A5) 
We now calculate Ii{x-,w). The Fourier transform of C, is 

+ wi) = — i-^ / d^kP{k, k ■ n)e*^-(^-+'"^^\ (A6) 



(27r)3 „ 

where -P(A;, A; ■ fi) is the redshift space power spectrum given by, 

P{k, k-n) = P{k) {-iyAi{P)PiCk ■ h) . (A7) 
1=0,2,4 

The coefficients Ai{j3) are defined in equation (^. For convenience of computation, we take 
the line-of-sight vector n to lie along the z axis. We first perform the integrals over the 
angles Qi and ^2 in equation (PB|). Using, 



gifc-^^i =47rJ2 t'''jLikw)YLM{nk)Ylj,,{n^,), (A8) 

L,M 

we have, 

/ ^e^'--^^Pz(/^i) = 2^-'Ukw)Pl{^^,), (A9) 
where fik = cos(A; ■ n). Thus, 

Ii{S.,w) = ^J d'kP{k, k ■ n)e'^-^^-ji{kw)PiM. (AlO) 
Substituting equation ( |A7| ) in above equation And integrating over d^k , 

hix-, ^) = ^ E (2^' + a;-)P,' (cos^.J, (All) 

^ /'=o 

where, 

«"=0,2,4 

Bl(/, /',/") = J dfikPi M Pi' M Pi" M , (A12) 

(A13) 



and 

= J dkP ji{kw)jf{kx^)P{k). (A14) 

The contribution of the second term in equation. ( P^D to < o"q ^ (w) > can be computed 
in a similar fashion. 
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Fig. 1. — vl and v2 are observed velocities of two objects along the line-of-sight, with a 
small angular separation 'ip. Their separation is velocity space is w which makes an angle 9 
with the line-of-sight. The velocity separation along the line of sight is v and perpendicular 
to the line-of-sight is H{z) D{z) ip. 



-23- 




Fig. 2. — Ratio of H{z) D{z) in a Model to its value in the fiducial Qq — 1 Model. Qq — 0.3 
for all three Models. 
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Fig. 3. — Ratio of H{z) D{z) in a Model to its value in the fiducial Qq — 1 Model. Qq — 0.7 
for all three Models. 
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Fig. 4. — The light hnes corresponding to the fiducial VIq = 1 Model. The bold lines 
correspond to f2o = 0.3, Aq = 0.7 Model. Note that it is the absolute values of the coefficients 
that have been plotted. In particular the quadrupole is negative. 
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Fig. 5. — Both the hght and bold hnes assume a cosmological geometry corresponding to 
the Qq = 0.3, Aq = 0.7 Model. The light lines correspond to = 1 CDM power spectrum 
in units of inverse velocity. The bold hnes correspond to Qq — 0.3,Ao = 0.7 CDM power 
spectrum. 
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Fig. 6. — Figure shows the estimated shot noise error on the the Ci coefficients. Pairs are 
binned such that each bin centered at Ws was assumed to have a bin size given by Ws ± l/5ws. 
This corresponds to binning where every successive bin is centered at a value 1.5 times that 
of the previous bin. For small separations the error approximately scales as the inverse of 
the cube of the size of the bin. The number of pairs rapidly reduce as separations approach 
the radius of the survey and hence the shot noise error on scales close to the radius of the 
survey is large. 
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Fig. 7. — The cosmic variance error on the Ci coefficients are shown for the fiducial = 1 
Model. 



